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Research  Results 


(a)  Large  deviations  and  control  of  rare  events.  A  major  concern 
in  stochastic  systems  theory  are  problems  where  the  effects  of  the  noise  are 
small.  For  example,  in  many  modern  communications  and  computer  systems 
one  wishes  error  rates  on  the  order  of  10~^  or  so.  Much  of  the  theoretical 
underpinning  of  estimates  that  are  available  comes  from  the  theory  of  large 
deviations.  Our  work  has  addressed  two  current  needs:  extension  of  the 
theory  to  cover  practically  interesting  problems  (such  as  design  of  data  net¬ 
works),  and  the  development  of  computational  methods  for  large  deviation 
problems.  There  has  been  virtually  no  work  on  numerical  problems  in  this 
area.  Indeed,  the  classical  approach  to  this  theory  is  so  complex  that  the 
associated  numerical  problems  would  appear  impossible.  With  this  in  mind, 
we  are  developing  an  alternative  approach  that  in  a  general  setting  puts  the 
problem  into  a  control  theory  framework.  In  reference  [1]  above  we  have  ap¬ 
plied  this  approach  to  prove  the  e.xistence  of  a  large  deviation  principle  for  a 
very  broad  class  of  jump-Markov  processes  that  occur  in  queueing  problems. 
Tills  vasth"  widens  the  class  of  such  systems  for  wliicb.  sucli  a  princijile  is 
known.  The  proofs  use  a  characterization  of  the  large  deviation  probabilities 


cost  lunctions  oi  associated  stochastic  control  proijiem 


characterization  is  also  used  as  the  basis  for  computational  procedures  that 


arc  developed  in  reference  [-Ih  The  characterization':  serve  both  to  motivate 


and  understand  convenient  computational  approximations,  and  also  to  prove 


their  convergence. 

In  the  reference  [3]  we  have  started  to  address  the  theoretical  issues  as¬ 
sociated  to  a  specific  class  of  problems  that  involve  both  small  noise  and 
control.  The  problem  considered  in  [3]  is  that  of  controlling  an  already  "reli- 
able"  si'STern  so  as  to  make  it  as  reliable  as  possible.  Here  reliability  refers  to 
the  length  of  time  the  state  of  the  s\'stem  remains  in  an  acceptable  operating 
state.  The  assumption  that  the  system  is  already  reliable  simply  means  that 
we  are  dealing  with  a  system  with  small  noise  elfects.  For  such  sx'steins  the 
paramount  goal  is  they  remain  in  the  acceptable  operating  region  for  as  long 
as  possible.  Owing  to  the  unusual  nature  of  this  criteria  and  the  also  the 
smallness  of  the  noise  effects,  large  deviation  tlieor\’  oners  an  ideal  tool  lor 
the  analysis  of  such  problems.  In  future  work  we  plan  to  extend  the  algo¬ 
rithms  developed  in  [4],  which  deal  with  jump  processes  and  no  control,  to 
cover  a  broader  range  of  processes  and  also  processes  with  control. 
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(b)  Rates  of  Convergence  in  Optimal  Control.  In  [2]  we  developed 
a  simple  method  for  obtaining  rate  of  convergence  estimates  for  a  variety  ol 
approximations  in  deterministic  and  stochastic  optimal  control.  Heavy  use  is 
mad  of  representations  of  the  approximations  as  functionals  of  a  controlled 
Markov  process,  which  of  course  is  a  by-product  of  the  ‘‘Markov  chain  ap¬ 
proximation  method.”  The  method  is  illustrated  through  the  presentation 
of  a  number  of  examples,  including  finite  difference  schemes  with  several 
different  cost  structures. 

(c)  Work  on  Shape  Reconstruction.  Work  that  has  begun  but  is 
not  nearly  finished  involves  an  extension  of  previous  work  on  the  classical 
problem  of  shape-from-shading  to  handle  the  problem  of  shape-from-SAR 
data  (synthetic  aperture  radar  data).  Many  new  difficulties,  such  as  the 
differing  geometries  of  the  problems  and  the  presence  of  significant  noise 
in  SAR  data,  have  required  significant  alterations  in  the  algorithms  used 
previously.  This  work  is  still  proceeding. 
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